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1^ ■ 1. Introduction 

It is known that Markov processes are well-developed field of mathematics which have various 
applications in physics, biology and so on. But there are some physical models which cannot 
> I be described by such processes. One of such models is a model related to population genetics. 
O . Namely, this model is described by quadratic stochastic processes (see [7] for review). To define 
^ . it, we denote 

in ■ = {x = (xn) : = ^l^^l < oo; x^ e M}, 

O ; n=l 

■ S = {x e : Xn>0; \\x\\i = 1}. 

Hence this process is defined as follows (see [1],[9]): Consider a family of functions {P-j'jJ '■ 
G N, s, t G M^, t — s > 1}. This family is said to be quadratic stochastic process (q.s.p.) 

■ if for fixed s, t G M+ it satisfies the following conditions: 

H , 

^' (i) =P|gl for any z, J, fcGN. 

r 1 ^ r 1 

(ii) Pj^^ > and E^S^ = 1 for any k G N. 

k=l 

(iii) An analogue of Kolmogorov- Chapman equation; here there are two variants: for the 
initial point x^^-* G S, x^^^ = {xf'\xf\ ■ ■ ■ ) and s < r < t such that t — r>l,r — s>l 
(iiU) 



p[s,t] ^ p[s,r] p[r,t] (r) 

ij,k / J ■'^ij,m-'-r^' 

(r) 

(r) _ V^pM (0) (0) 

•^k ~ / ij,k -^i -^j 

1 



ij,m ml,k I ' 

m,l=l 



where x^. is defined as follows: 
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(iiifi) 

oo 

p[s.*] _ p[s,r]p[s,r]p[r,t] (s) (s) 

ij,k / J ^ im,l^ jg,h'-lh,k-^ra'^g ■ 

m,(,g,/i=l 

We say that the q.s.p. {Plf^ is of type (A ) or (B) if it satisfies the fundamental equations (iii^) 

or (iiifi), respectively. In this definition the functions -Pj^^f' denotes the probability that under 
the interaction of the elements i and j at time s the element k comes into effect at time t. Since 
for physical, chemical and biological phenomena a certain time is necessary for the realization of 
an interaction, we shall take the greatest such time to be equal to 1 (see the Boltzmann model 
[4] or the biological model [7]). Thus the probability P\^-'*^ is defined for i — s > 1. It should 
be noted that the quadratic stochastic processes are related to quadratic transformations (see 
[5], [7]) in the same way as Markov processes are related to linear transformations. 

The equations (111^) and (iiis) can be interpreted as different laws of behavior of the "off- 
spring" . 

Some examples of q.s.p. were given in [1],[3]. We note that quadratic processes of type 
(A) were considered in [1],[9]. One of the central problems in this theory is the study of limit 
behaviors of q.s.p. An ergodic principle is a such concept relating to limit behaviors one (see 
[6]). In [10] some conditions were given for q.s.p. to satisfy this principle. It is known [1],[2] 
that a certain Markov process can be defined by means of q.s.p., therefore, it is interesting to 
know the following question: if this Markov process satisfies the ergodic principle, then would 
q.s.p. satisfy that principle? The answer to this question gives us to find more conditions for 
fulfilling the ergodic principle for q.s.p., since the theory of Markov processes are well-developed 
filed. In the paper we are going to solve the formulated question for discrete time q.s.p. 

We note that a part of the results were announced in [8], [10]. 

2. Ergodic Principle for Quadratic Stochastic Processes 

In this section we will answer to the above formulated question for discrete time q.s.p. Before 
doing it, we prove some results concerning about Markov processes. 

In the sequel we will consider discrete time q.s.p., i.e. for {-Pj^'^} the numbers s,t belong to 

N. 

Recall that a matrix {Qij) is called stochastic if 

oo 

Qij > 0; YlQ^J = 1- 

First recall that a family of stochastic matrices {((5™'")ijeN '■ m, n e N, n — m > 1} is called 
discrete time Markov process if the following condition holds: for every m < n < I 

oo 

QT/ = (2-1) 

fc=i 

This equation is known as the Kolmogorov- Chapman equation . 
A Markov process {Q^'"} is said to satisfy the ergodic principle if 

lim \Qik - Qjk I = 
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is valid, for every fc,m G N. Note that this notion firstly was introduced in [6]. 
Each (Q^'"^)-stochastic matrix defines a linear operator Q™'" : £^ — > £^ as follows 

oo 

(Q-'-(a;)), = 5]g;r^- ^ = M e e. (2.2) 

i=l 

Stochasticity of (Qlj ") implies that 

CT'^'iS) C S and IIQ"''"^!!! < ||x||i, X e i^; (2.3) 
By {e*^"^} we denote standard basis of i.e. 

e(") = ( 0,0,-- ,1 ,---), neN. 

n 

Now we formulate the following well- know fact (see, for example [11]). 

Lemma 2.1. A sequences C converges weakly if and only if it converges in norm ofi^. 
We have following; 

Theorem 2.2. Let {Q™'"} be a Markov process. The following conditions are equivalent: 

(i) {Q™'"} satisfies the ergodic principle; 

(ii) For every i,j,m e N the following relation holds: 

lim IIQ'^'V^^-Q^^'^e^^^lli^O. 

(iii) For every (p,ip & S and m e N the following relation holds: 

lim ||Q"*'>- Q^^'^Vlli = 0. 

n^oo 

Proof. (i)=^(ii). The ergodic principle means that the a sequence x[^^^ — (Q^'" — Q^^^)ken 
converges weakly in here i,j, m e N are fixed numbers. According Lemma 2.1 we infer that 
■^ij^m converges strongly in this means 



lim^igr-^ri-o. 

k=l 

On other hand, from (2.2) we find 

oo 

||Q-,ngW _ Qm,ng(,)||^ _ ^ |grn,n _ gm,n|_ ^2.4) 

fc=l 

Hence, the considered implication is proved. 
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M N ^ 

(ii)=^(iii). First consider the following elements: ^ = X] V — ^ where ai^Pj > 

i=l 3=1 

M N 

0, Y^ai= I3j — 1. Using (ii) we have 

M N 

||Qm,n^ - Q'"''^77||i = II ^aiQ™'"e« - J] /3jQ'"'''e(^)|| 

i=i j=i 

M N M N 

= II J] ^ a,/3,Q-'"e« o^AQ"''"^^'^ II 

i=l j=l i=l 1=1 

M N 

< ^^ai/3,||Q'"'"e«-Q"^'V^')||i^0 as n ^ oo. (2.5) 
i=i j=i 

Now let (p,ip E S and e > 0. Denote 

M M 

G = {i = J2 ^i^^^ : a, > 0; ^ tti = 1, Me N}. 

i=l i=l 

It is clear that G is dense in S. Therefore, there exist ^, rj E G such that 

\\if-C\\i<e/3, U-r]\\,<e/3. 
According to (2.5) there is no G N such that 

||Qm,n^ - Q^^'^lli < e/3, Mn > no. 
Hence, by means of above relations and (2.3) we obtain 

IIQ'^'V - Q"''V||i < ||Q'"'"(<^ - Olli + l|Q'"'"(V' - ^)l|i + IIQ"''"e - Q^'^^lli 
< ll¥'-Clli + IIV'-^lli + £/3<£ 

for all n >no. Thus the implication is proved. The implication (iii)=^(i) is obvious. □ 
Let {pIJY^^} be a q.s.p. Define 

oo 

Kir=E^irM'"^ hj^^- (2-6) 
1=1 

It is clear (H^''*) is a stochastic matrix. 

Lemma 2.3. Let {Plj^k"'^} be a q.s.p. Then {H™"'"} is a Markov process. 
Proof. Consider two distinct cases with respect to types of q.s.p. 
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Case (a) . Let P}^^^ be a q.s.p of type (A). Then we have 



oo oo / oo 



k=l k=l \u=l / \v=l 

El p[m,n]p[n,l]M \ M 

u=l \k,v=l / 
oo 



u=l 



So {Q^'"} is a Markov process. 

Case (b) . Let -Pj^"^"' be a q.s.p of type (B). First consider 



oo 



Ep[m,n] (m) (rn) _ p[m,n] p[0,m] ^(0) ^(0) | ^{0) JO) 

i,j=l i,j=l \e,f=l / \c,d=l 

oo / oo \ 

Ef \^ p[0,m] p[0,m] p[m,n] (0) (0) \ (0) (0) 
I -^e/,i -f^cdj Uj,k -^f -^d I -^e -^c 

c,e=l \f,d,i,j=l / 

oo 

~ Z^ ec,A; -^e -^c " -^fe ■ 
e,c=l 

So 

oo 

•^k — ^ij,k -^i -^3 ■ 

Using this equahty check Markovianity: 

oo oo / oo \ 

wnm,l _ p[™.']™M _ I pN.n] p['"."l p[".']™(m)^(m) \ ^(m) 

™ij ~ Z^ MfeJ -^fe ~ Z^ I Z^ Ma,6 -^A;c,(i "^bdj "^a -^c I -^fc 
fe=l fc=l \a,6,c,(i=l / 

oo / oo \ / oo \ 

El y^p!"*'"]2;M j I Y^ p[m,n\^{^)^{m) \ p[nA 
\ / J iOi^b o, II / J kc^d k c I bdyj 



b,d=l \a=l / \k,c=l 

oo / oo \ / oo 



E ( E^lT'^i™^ EOi"^ ) = EC'^S' 

6=1 \a=l / \d=l / 6=1 



□ 



The defined process {H^'"} is called associated Markov process with respect to q.s.p. By 
jjm.n denote the linear operator associated with this Markov process (see (2.2)). 
We say that the ergodic principle holds for the q.s.p. {-Pj|^"^"'} if 

l^m I pI™'"] _ p[™'"l| _ n 

uv,k I ~~ ^ 
n— >oo •" ' 
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is valid for any i, j, u,v,k & N and arbitrary m e N. 
Define 



^r(^)=E^ir^^'' (2-7) 



1=1 

fiere x = (xn) € ^S*. It is clear that for each m, n e N and x E S the matrix {R^'"'{x)) is 
stochastic. 

Proposition 2.4. Let {-P/^j'"^} be a q.s.p. Then the following conditions are equivalent: 

(i) For every i,j, k eN and x E S the following holds: 

hm ^7/(^)1=0- 

n— >oo 

(ii) The Markov process {H^'"} satisfies the ergodic principle. 

Proof. The imphcation (ii)=^(i). Again divide the proof into two cases. 
Case (a) . Let {pIJ]^"'^} be a q.s.p. of type (A). Then we have 

oo oo / oo \ 

1=1 1=1 \u,v=l J 

oo oo 

- EE^ir^^'c^^'"^' 

1=1 u=l 

oo 

u=l 

where = ^ pI^J^'^^^xi. Similarly, one gets 
1=1 

oo 
w=l 

The ergodic principle for the Markov process with Theorem 2.2 implies that 

||H"^^''"y(i)-H"^+''"y(j)||i^O as n ^ oo. 

Therefore, 

< ||H"^+^'"y(i) -H"*+^'"y(j)||i ^ as n^oo. 

Case (b) . Now suppose that (-Pj^"^'"') is a q.s.p. of type (B). Given x E S define operator 
R"*'"(x) -.e^^e^as follows: 

i=l 

1/ = (i/i) E i^. Using stochasticity of {R^'"'{x)) we infer 

||(R'"'»)(|/)||i< Ill/Ill, Vye£^ (2.8) 



ON THE ERGODIC PRINCIPLE 



Now using (iii) b we find 



oo / oo 



1=1 \a,b,c,d=l 



oo oo 
1=1 b,d=l 

= (R"''^+i(|/))(H"^''^(e«))fc, (2.9) 
here y — H"*'"'(a;). Similarly, one gets 

= (R"'"+i(y))(H-'-(e(^))),. (2.10) 
Therefore, it follows from (2.8)-(2.10) that 

IKk''^^^) - RT^\^)\ = |(R"'"+'(y))(H"^'"(e«) - H"^'"(e(^)))fc| 

< ||(R"'"+^(y))(H"^'"(e(*)) -H"^'"(e(^)))||i 

< ||H"^'"(e(^)) -H"*'"(e(^))||i ^0 as n ^ oo. 

This completes the proof. □ 

Proposition 2.5. Let {-Pj^™'"'} be a q.s.p. Then the following conditions are equivalent: 

(i) l-Pjj"^'"'} satisfies the ergodic principle; 

(ii) For every x & S and i,j, k,m the following holds: 

hm ii?r(^)-^r(^)i = o. 

n— >oo 

Proof, (i)^(ii). Define a bihnear operator pl"^'"'] : £^ x £^ — > £^ as follows 

oo 

(P^^{x,y)),= J2P^^^^^y^^ 

where x — {xn),y = {yn) G According to Lemma 2.1 from ergodic principle we find 

lim ||pl™'"l(e«,e^^')) - p['"'^^](e("), e(^))||i = 

71 -^OO 

for every u,v,m e N. The same argument of the proof of Theorem 2.2 implies that 

lim ||p['"'"](e(^\x) -P['"''*l(e("),y)||i = 0, 

n— »oo 

for every x,y e S. Hence, we have 

iRTk^'ix) - i?,T(x)| < ||p["^'"l(e«,x) - P["^'"l(e(^),x)||i ^0 as n ^ oo. 
Now consider the imphcation (ii)^(i). Prom (2.7) we have 

\p!:^ - P^:f\ = - - O as n ^ oo; 

for every i,j, k,u eN. Whence one gets 

\-^ij,k ^uv,k I — \-^ij,k ^uj,k I \-^ju,k ^vu,k \ ^ ^ — >■ OO, 

here we have used the equation (i) of definition q.s.p. □ 
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Now we are ready to formulate our main result. 

Theorem 2.6. Let {P^J]^"'^} be a q.s.p. The following conditions are equivalent: 

(i) {-Pjj"^'"^} satisfies the ergodic principle; 

(ii) The Markov process {H^^"} satisfies the ergodic principle. 

The proof immediately follows from Propositions 2.4 and 2.5. 

3. An application of the main result 

In this section we give certain conditions for the Markov process which ensure fulfilling the 
ergodic principle for q.s.p. 

Now we need some auxiliary facts. 

Lemma 3.1. Let {an} be a nonnegative sequence which satisfies the following inequality 

n 

On < (1-A„)a„_i + J](l-Afe), (3.1) 

k=l 

where A„ G (0, l),Vn G N and 

CO 

^A„ = oo, (3.2) 

n=l 

n 

n n(i-Afc) 

)• as n ^ oo, (3.3) 

U ^^-^^^ 

then lim a„ = 0. 

n— »oo 

Proof. Prom (3.1) by iterating we get 

n 

n n n(l~Ajt) 

an < ai - A.) + E 't-X ) ■ ^^-^^ 

i=2 j=l ^ ^' 

n 

The condition (3.2) with < A^ < 1 imphes that 11(1 ~ Ajt) ^0 as n — > oo. Hence, by 

fe=i 

means of (3.3) we obtain a„ — > as n — > oo. □ 

Corollary 3.2. Let {an} be as above. If the sequence {Xn}, (0 < A^ < l,Vn G N) satisfies 
(3.2) and the following relations 

n 

n 

k=l 



, j^(l — Afc)— >0 as n ^ oo (3.5) 



A 



EtzV = 0('') (3.6) 



i=l 



then lim a„ = 0. 

n— >oo 
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Proof. It is enough to show that the conditions (3.5), (3.6) imply (3.3). Indeed, since < 
1 — Aj < 1, we can write 

here Sj is a some positive number. It then follows that 

n ^ n n ^ 

j=i J j=i j=i J 

It follows from (3.6) that 

n ^ 

^^<C-n (3.7) 

for all n e N, here C is a constant. Therefore, from (3.7), (3.4) and (3.5) we infer that 



n n (1 ~ ^k) n n 

j=l ■> k=l 3=1 ■' 



n 

— • n ]^(1 — Afc) ^ as n — > oo 

k=l 

□ 

Theorem 3.3. Let {Q"j'^''} be a Markov process. If there exists a number ko e N and a sequence 
{Xn}, < Xn < l,Vn e N satisfying (3.2), (3.3) such that 

Qrfc;''">^n for all i,neN. (3.8) 

Then the Markov process satisfies the ergodic principle. 

Proof. We set 

sup Q -fee = Mk,n{ko); inf Q-feo = mk,n{ko). 
ie'N »6N 

For i < k < n we have 

oo oo 

« = E QuQi^ ^ ^'"(^o) E = ^,n(A;o). (3.9) 
/=1 1=1 

Similarly, 

Qig > m,,n{ko) (3.10) 

By means of (3.8) we infer 

- Ang;,-;'" > (3.11) 
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for all i,j eN, because < (3^^,^'" < 1. It follows 



1=1 

oo oo 
oo 

= (1 - Xk)mk,n{ko) + AfcQ^feo^'", 



whence 



Q.V''^ - Qik-''"" < (1 - - mUko)). 

Since (3.12) holds for any i,j e N, from (3.9)-(3.10) we find 

Mk-i,„{ko) - ■mk-i,n{ko) < (1 - Xk){Mk,n{ko) - mk,n{ko)). 
So iterating the last inequality we get 



n-l 



Mi,n{ko) - mi,n{ko) < Yli^- Afe). 

k=l+l 

Using (2.1) we have 



1=1 



for every i,j e N. Hence by means of (3.8) it yields that 

oo oo 
k=l,ky^ko l,k=l 



I'^il ~ '^jl Nlko 

1=1 

oo 

< (i-A„)EiQr''-Qr"'i- 



Now add ig^;'' - g™;"! to both sides of (3.15). Then 



E - QT\ < (1 - An) E i^r"' - QTr'i + iCo" - Qj 

k=l 1=1 

Now by means of (3.14) and (2.4) we infer 

n-l 

||Qm,n(g(i)) _ Q"»."(e(^))||i < (1 - Xn)\\Cr'"-\e^^) - Q"^'"-^(e(^))||i + JJ 

j=m+l 
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II 



Denoting a„ = ||Q"^'"'(eW) — Q™'"(e*^-^^)||i and applying Lemma 2.1 to a„ one gets that 

||Qm,n^g(0)_Qm,n(gO))||^^Q ^ ^ ^ OO. 

So, according to Theorem 2.2 we obtain the required assertion. □ 

Now we can formulate the following 

Theorem 3.4. Let {-Pj^™'"^} be a q.s.p. If there exist a number /cq € N and a sequence {An}, 
(0 < An < 1) satisfying the conditions (3.2), (3.3) such that 

Pl;,C'''^>Xn for all z,jeN, (3.16) 
then the q.s.p. satisfies the ergodic principle. 

Proof. Consider the Markov process {H^'"} associated with given q.s.p. (see (2.6)). Then 
(3.16) imphes that 

oo oo 

= E^ii""'^J""^ ^ An^^r^) = An. 
1=1 1=1 

Consequently, the Markov process satisfies the conditions of Theorem 3.3. Therefore the ergodic 
principle is valid for it. Now by means of Theorem 2.6 we infer that q.s.p. satisfies the ergodic 
principle. □ 
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